Markov decision process based time-varying optimal control for colloidal self-assembly

Markov decision process based time-varying optimal control for colloidal self-assembly

Crystals made of periodically well-ordered nanoand/or micro-scale elements can interact with light to give novel properties. These perfect crystals have applications in a wide range of areas. For example, invisibility cloaks that reroute light transmission make objects disappear. However, manufacturing such perfect crystals still remains challenging. Here, we propose a low-dimensional Markov de...

Constrained Markov Decision Process and Optimal Policies

In the course lectures, we have discussed a lot regarding unconstrained Markov Decision Process (MDP). The dynamic programming decomposition and optimal policies with MDP are also given. However, in this report we are going to discuss a different MDP model, which is constrained MDP. There are many realistic demand of studying constrained MDP. For instance, in the wireless sensors networks, each...

Monotone optimal control for a class of Markov decision processes

This paper provides a unified framework to study monotone optimal control for a class of Markov decision processes through D-multimodularity. We demonstrate that each system in this class can be classified as either a substitution-type or a complement-type system according to the possible transition set, which can be used as a classification mechanism that integrates a variety of models in the ...

A Computational Method for Solving Optimal Control Problem of Time-varying Singular Systems Using the Haar Wavelets

Numerical Solution of Optimal Control of Time-varying Singular Systems via Operational Matrices

In this paper, a numerical method for solving the constrained optimal control of time-varying singular systems with quadratic performance index is presented. Presented method is based on Bernste in polynomials. Operational matrices of integration, differentiation and product are introduced and utilized to reduce the optimal control of time-varying singular problems to the solution of algebraic ...